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A. If the status is the same, pay the TOTAL FEE(S) DUE shown 
above. 

B. If the status above is to be removed, check box 5b on Part B - 
Fee(s) Transmittal and pay the PUBLICATION FEE (if required) 
and twice the amount of the ISSUE FEE shown above, or 
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A. Pay TOTAL FEE(S) DUE shown above, or 



B. If applicant claimed SMALL ENTITY status before, or is now 
claiming SMALL ENTITY status, check box 5a on Part B - Fee(s) 
Transmittal and pay the PUBLICATION FEE (if required) and 1/2 
the ISSUE FEE shown above. 



II. PART B - FEE(S) TRANSMITTAL, or its equivalent, must be completed and returned to the United States Patent and Trademark Office 
(USPTO) with your ISSUE FEE and PUBLICATION FEE (if required). If you are charging the fee(s) to your deposit account, section "4b" 
of Part B - Fee(s) Transmittal should be completed and an extra copy of the form should be submitted. If an equivalent of Part B is filed, a 
request to reapply a previously paid issue fee must be clearly made, and delays in processing may occur due to the difficulty in recognizing 
the paper as an equivalent of Part B. 

III. All communications regarding this application must give the application number. Please direct all communications prior to issuance to 
Mail Stop ISSUE FEE unless advised to the contrary. 

IMPORTANT REMINDER: Utility patents issuing on applications filed on or after Dec. 12, 1980 may require payment of 
maintenance fees. It is patentee's responsibility to ensure timely payment of maintenance fees when due. 
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Determination of Patent Term Adjustment under 35 U.S.C. 154 (b) 

(application filed on or after May 29, 2000) 

The Patent Term Adjustment to date is 581 day(s). If the issue fee is paid on the date that is three months after the 
mailing date of this notice and the patent issues on the Tuesday before the date that is 28 weeks (six and a half 
months) after the mailing date of this notice, the Patent Term Adjustment will be 581 day(s). 
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The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with 
your submission of the attached form related to a patent application or patent. Accordingly, pursuant to 
the requirements of the Act, please be advised that: (1) the general authority for the collection of this 
information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary; and (3) the 
principal purpose for which the information is used by the U.S. Patent and Trademark Office is to process 
and/or examine your submission related to a patent application or patent. If you do not furnish the 
requested information, the U.S. Patent and Trademark Office may not be able to process and/or examine 
your submission, which may result in termination of proceedings or abandonment of the application or 
expiration of the patent. 

The information provided by you in this form will be subject to the following routine uses: 

1 . The information on this form will be treated confidentially to the extent allowed under the Freedom 
of Information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from this system of 
records may be disclosed to the Department of Justice to determine whether disclosure of these 
records is required by the Freedom of Information Act. 

2. A record from this system of records may be disclosed, as a routine use, in the course of presenting 
evidence to a court, magistrate, or administrative tribunal, including disclosures to opposing counsel 
in the course of settlement negotiations. 

3. A record in this system of records may be disclosed, as a routine use, to a Member of Congress 
submitting a request involving an individual, to whom the record pertains, when the individual has 
requested assistance from the Member with respect to the subject matter of the record. 

4. A record in this system of records may be disclosed, as a routine use, to a contractor of the Agency 
having need for the information in order to perform a contract. Recipients of information shall be 
required to comply with the requirements of the Privacy Act of 1974, as amended, pursuant to 5 
U.S.C. 552a(m). 

5. A record related to an International Application filed under the Patent Cooperation Treaty in this 
system of records may be disclosed, as a routine use, to the International Bureau of the World 
Intellectual Property Organization, pursuant to the Patent Cooperation Treaty. 

6. A record in this system of records may be disclosed, as a routine use, to another federal agency for 
purposes of National Security review (35 U.S.C. 181) and for review pursuant to the Atomic Energy 
Act (42 U.S.C. 218(c)). 

7. A record from this system of records may be disclosed, as a routine use, to the Administrator, 
General Services, or his/her designee, during an inspection of records conducted by GSA as part of 
that agency's responsibility to recommend improvements in records management practices and 
programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance 
with the GSA regulations governing inspection of records for this purpose, and any other relevant 
(i.e., GSA or Commerce) directive. Such disclosure shall not be used to make determinations about 
individuals. 

8. A record from this system of records may be disclosed, as a routine use, to the public after either 
publication of the application pursuant to 35 U.S.C. 122(b) or issuance of a patent pursuant to 35 
U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37 CFR 1.14, as a 
routine use, to the public if the record was filed in an application which became abandoned or in 
which the proceedings were terminated and which application is referenced by either a published 
application, an application open to public inspection or an issued patent. 

9. A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local 
law enforcement agency, if the USPTO becomes aware of a violation or potential violation of law or 
regulation. 
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Application No. 

10/582,849 

Examiner 

SHAUN ROBERTS 



Applicant(s) 

BADINO ET AL. 
Art Unit 

2626 



~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . ^ This communication is responsive to the communication filed 8/18/201 1 . 

2. □ An election was made by the applicant in response to a restriction requirement set forth during the interview on ; the restriction 

requirement and election have been incorporated into this action. 

3. The allowed claim(s) is/are 18-34 . 

4. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

5. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

6. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Drafts person's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

7. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . □ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. M Examiner's Statement of Reasons for Allowance 

9. □ Other . 
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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 8/18/201 1 has been entered. 

This action is responsive to the communication filed 8/1 8/201 1. Claim 18 and Fig 2 are selected 
to be printed in the OG. 

Response to Amendment 

1. Claims 18 and 26 have been amended. 

Applicant's Amendments and Arguments/Remarks filed 8/18/201 1 provide persuasive 
arguments as to why the case is allowable. 

Allowable Subject Matter 

2. Claims 18-34 are allowed. 

The following is an examiner's statement of reasons for allowance: 
Regarding claim 18 Applicant's invention is novel in respect to the prior art listed as the 
invention teaches: similarity tests performing a category-to-category comparison between a 
vector representative of phonetic categories of set of phonemes of a second language and a 
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vector representative of phonetic categories of set of candidate mapping phonemes, said 
similarity test being independent of a first language and said second language. 

Regarding claim 18 Campbell teaches a method for text-to-speech conversion of a text in 
a first language comprising sections in at least one second language (Intro para. 3: pronounce 
the foreign words that appear in a multi-lingual text), comprising the steps of: 

converting said sections in said second language into phonemes of said second language 
(2 Multi-Lingual Text para 4: produce a phonetic rendering of each utterance); 

mapping at least part of said phonemes of said second language onto sets of phonemes of 
said first language [Intro para. 5: match the sounds of the target speech through the use of a 
mapping vector; 3.1); 

including said sets of phonemes of said first language resulting from said mapping in the 
stream of phonemes of said first language representative of said text to produce a resulting 
stream of phonemes; and generating a speech signal from said resulting stream of phonemes (3.1 
Phone Mapping; Intro para. 3: pronounce the foreign words that appear in a multi-lingual 
text . . . synthesizing email or . . .pages ...), 

wherein said step of mapping comprises: carrying out non-acoustic similarity tests 
between each phoneme of said phonemes of said second language being mapped and a set of 
candidate mapping phonemes of said first language, said similarity test performing a comparison 
between a vector representative of said phonemes of said second language (3.2: target cepstrum 
vector) and a vector representative of said set of candidate mapping phonemes (3.2 candidate 
unit cepstral vector), said similarity test being independent of said first language and said second 
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language {Intro para. 5: match the sounds of the target speech through the use of a mapping 
vector; 3.1 Phone Mapping; 3.2: 4 th -5 th para.- showing the use of vectors in determining scores 
for comparing similarity of phonemes; where comparison is independent of language, allowing 
for mapping between any sets of languages); 

assigning respective scores to the results of said tests; and mapping each said phoneme of 
said second language onto a set of mapping phonemes of said first language selected from said 
candidate mapping phonemes as a function of said scores (3.1, 3.2: the sequence of candidates 
having the lowest... scores is passed as input to the waveform concatenation ; Conclusion para. 
1). 

Campbell does not teach similarity tests performing a category-to-category comparison 
between a vector representative of phonetic categories of each of said phonemes of said second 
language and a vector representative of phonetic categories of each of said set of candidate 
mapping p honemes. 

Campbell teaches vectors representing speech data (cepstrum vector), but does not 
specifically mention vectors representing phonetic categories. 

Another previously cited and closely related art Iso-Sipila (2005/0144003) teaches 
mapping the first phoneme sequence to a second sequence of pronunciation phonemes in at least 
one second language, and generating an audio output of the phonemes in the second phoneme 
sequence using prosody models adapted for the at least one second language; and further 
mentions the use of SAMPA (Speech Assessment Methods Phonetic Alphabet), which basically 
consists of a mapping of symbols of the International Phonetic ALaphabet onto ASCII codes. 
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However, while Iso-Sipila teaches mapping and the use of phonetic alphabets, it does not teach 
similarity tests performing a category-to-category comparison between a vector representative of 
phonetic categories of each of said phonemes of said second language and a vector representative 
of phonetic categories of each of said set of candidate mapping p honemes. 

It has already been established that phonetic categories are well known in the art (based 
on the International Phonetic Alphabet by the International Phonetic Association), however there 
is not enough evidence or specific teachings in the art to read on the recited limitation of 
similarity tests performing a category-to-category comparison between a vector representative of 
phonetic categories of each of said phonemes of said second language and a vector representative 
of phonetic categories of each of said set of candidate mapping p honemes. 

Regarding claim 26 Campbell teaches a system (where the method of Campbell is 
inherently tied to a system for implementation) but the claim recites similar subject matter as 
claim 18, and is allowed for similar rationale and reasoning as claim 18 above. 

Therefore regarding independent claims 18 and 26 the prior art or combination thereof 
fails to disclose or fairly make obvious: 

A method and system for text-to- speech conversion of a text in a first language 
comprising sections in at least one second language, comprising the steps of: 
converting said sections in said second language into phonemes of said second language; 
mapping at least part of said phonemes of said second language onto sets of phonemes of said 
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first language; 

including said sets of phonemes of said first language resulting from said mapping in the stream 
of phonemes of said first language representative of said text to produce a resulting stream of 
phonemes; and 

generating a speech signal from said resulting stream of phonemes, 
wherein said step of mapping comprises: 

carrying out non-acoustic similarity tests between each phoneme of said phonemes of said 
second language being mapped and a set of candidate mapping phonemes of said first language, 
said similarity tests performing a category-to-category comparison between a vector 
representative of phonetic categories of each of said phonemes of said second language and a 
vector representative of phonetic categories of each of said set of candidate mapping p honemes 
said similarity test being independent of said first language and said second language; 
assigning respective scores to the results of said tests; and 

mapping each said phoneme of said second language onto a set of mapping phonemes of said 
first language selected from said candidate mapping phonemes as a function of said scores. 

3. Claims 19-25, 27-33, and 34 (which incorporates/performs the steps from claim 18) are 
therefore allowed due to their dependency on claims 18 and 26, which further limit the 
independent/parent claims. 

4. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
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fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to SHAUN ROBERTS whose telephone number is (571)270-7541. 
The examiner can normally be reached Mon - Fri 7-4 est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis Smits can be reached on (571)272-7628. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/S. R./ 

Examiner, Art Unit 2626 



/Talivaldis Ivars Smits/ 
Primary Examiner, Art Unit 2626 



10/07/2011 



